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They identified 80 neighbourhoods to evaluate the Convivencia approach (civilian apparatuses 
for dispute resolution, family problems and street disorder). 


For 20 months the city intensified civilian apparatus in 40 neighbourhoods, assigning full-time 
liaisons to improve public order, communication with the government and connect residents to 
dispute resolution and family social services. Representing a 60-fold (aumento de 60 veces) 
street presence. 


On average “Operación Convivencia” had no impact on reported governance, legitimacy, or 
crime. But they are different impacts by neighbourhood. 

In neighbourhoods where the state began weak, the task force and city agencies worked 
sporadically, and opinions of governance fell. 

Where the state began relatively strong, the liaisons and task force delivered, and this raised 
state legitimacy and reduced crime an emergency call. 

This result only points out the importance of existing state capacity and the dangers of over- 
promising and under-delivering. 


Introduction 

Medellin and Colombia introduced civilian security agencies, in which neighbourhood-level staff 
is responsible for dispute resolution, family disturbances, managing public spaces and building 
capacity of community groups to manage local problems. 

The authors identified 80 low and middle-income neighbourhoods and experimentally increase 
of their civilian public safety apparatus in a random half of the sample. 


Context: 2.7 police officers per 1,000 residents. 


Intervention: 

1. Alcaldia created a special task force to ensure that needs in the 40 treatment 
communities would get priority attention in the city’s many service agencies. This 
includes city’s main dispute resolution officers for problems between and within families 
or basic services. 

2. Each neighbourhood receive a full-time “liaison” a street level bureaucrat whose job was 
to rejuvenate community government organizations, advertise link people to 
government agencies, identify public service needs for the task force to fix and for family 
business. 

This intervention sought to evaluate the returns to increasing a broad range of “norma 
municipal services for basic order and community organization. Alcaldia was focused on 


|” 


improving public-service delivery, reducing crime, and generally improving the image and 
legitimacy of the state. 


The authors pick 80 “neighbourhoods”; described as 10 city blocks with about 1,000-3,000 
residents each. Typically, part of the lower-income neighbourhoods. 

Intervention started in early 2018, neighbourhoods were assigned to receive a 60-fold increase 
in street level attention to problems. But police patrolling didn’t change with the intervention. 
They centralize and focus the experiment because they wanted to maximize statistical power 
(SUPER SELECTION BIASED AND STILL NO AVERAGE EFFECTS). 


Since Medellin has many “combos” (groups in a variety of illicit business) that provide some 
degree of basic order, local security, dispute settlement and debt collection. Financed by weekly 
fees called vacunas. 
By interviewing 2,400 people in the 80 neighbourhoods, the authors found 17 forms of 
everyday order and governance that could be provided by the state, gangs or both. 
With these answers the authors create and based their results in two major outcomes, 
calculated as the difference between absolute state and combo measures. 

a) Index of relative state governance. 

b) Index of relative state legitimacy. 


The authors found no evidence that intensifying civilian personnel and attention improved any 
of the outcomes on average. 

Residents in treated neighbourhoods reported roughly 6% lower opinion of relative state service 
provision, statistically significant at 10%. The intensification of everyday forms of governance 
yielded no apparent returns and may even have backfired. 

This means that even in a city with a strong well-funded municipal government in Latin America, 
increasing unarmed street-level presence 60-fold had no effect on order, security or legitimacy. 


Program effect can be determined by initial conditions. Therefore authors divide 80 sectors into 
above or below-median levels of initial state presence and examine the program effects. 


Where the state began initially stronger, residents report significantly more interactions with 
city staff and events, cause liaisons were able to execute intervention effectively. Where the 
state began initially weak, they reported fewer. Cause central task force or other officials were 
unable to deliver important promises. Authors obtain similar outcomes on governance and 
legitimacy. 


This raise expectations of what the task force and municipal apparatus could deliver. 

In initially well-governed sectos, the program increased state legitimacy by almost 10% and 
decreased crime by 28%. Emergency calls to the police also fell by 41%. 

But in poorly governed sectors, residents reports of state responsiveness fell about 8% by 
significance level of 10%. There also was a weak decrease in state legitimacy and crime 
prevention. 


In either chase there were no evidence of a gang response for any neighbourhood. 


MEDELLIN CONTEXT 

Interviewed 23 community leaders and 141 community residents and shopkeepers. 19 police 
officers and officials, 17 city officials, 10 prosecutors and 18 other crime and security experts, 
118 combo leaders/members distributed in 41 gangs. 

Based on those answers, authors designed a survey to measure state legitimacy and its 
responsiveness to insecurity and disputes. 

After stratified the city by barrio, authors randomly selected 16% of the 14,600 blocks in 
Medellin. The sample was only made within the 223 low- and middle-income barrios. 

From each sample block authors interviewed two households and one business, for an average 
of 21 survey respondents per barrio. REPRESENTATIVE CITY SAMPLE OF BLOCKS. 

The EXPERIMENTAL SAMPLE 80 small neighbourhoods. Out of these, only 40 neighbourhoods 
received intervention, they represented less than 2.5% of all city blocks. They do not find 
evidence for spill overs. 


By a qualitative work authors identified 17 most common disputes and forms of disorder. Then 
they create an index of State governance (0 = 1). Survey also asked about state legitimacy, how 
much they trust state and Alcaldia. 


STREET GANGS 

Combo territories usually cover 10-25 blocks. They are relevant cause usually they offer 
protection and dispute resolution services. A duopoly of coercion between state and gang 
authorities. 


Therefore, authors construct the Relative State Governance measure. Calculated as the 
difference between these state governance and combo governance. But if gangs maintain order 
on the streets the police may be less likely to be called into the neighbourhood, and residents 
may be more likely to share information or collaborate with the state. So the paper also analized 
impacts on combo behaviour in addition to that of the state. 


INTERVENTION 

The idea came from Medellin’s poorer and under-served neighbourhood called LA LOMA. In 
which Medellin authorities already had stablished city-wide program of community liaisons but 
they were few in number. 


EXPERIMENTAL SAMPLE 

A neighbourhood of 5-10 blocks with 200-600 households (1,000-3,000 residents) Experimental 
sectors were not randomly assigned ??? but they are broadly representative of the city’s 
neighbourhoods in terms od their demographics, geographics and variation of state combo 
governance. We have the neighbourhoods with a lot of state presence and others in which it 
was the first time to see a representative. 


The city attempt to intensified normal civilian public safety and coexistence services in 40 
neighbourhoods (out of the 80). For 20 months, control sectors receive “normal” services the 
hole time. 

The intervention had both top-down and bottom-up aspects. 


~Top-down 

The alcaldia created a inter-agency task force to respond to local concerns. This includes normal 
services, some security concerns, resolution for dispute, communication with society or family 
services. Police commanders were asked to go twice to a meeting with “Consejos de 
Convivencia”. The mayor office also organize a “Caravana de la Convivencia” daban pan y agua 
con la presencia de los delegados. 


~Bottom-up 
The city also assigned a full time level bureaucrat to each treated sector. Treated sectors had 1 
liaison per 9 blocks. They have several roles like: 

Collect and register community concerns to the inter-agency task force. 

Organize community events apart from the ones mentioned above. 

Help community organizations. 

Work with police officers for the “police code”. 


LIMITATIONS AND NON-Compliance 

The city does not maintain similar administrative data on the activities of the 16 liaisons 
covering all comunas. But they estimate that control groups receive basically the same 
activities. 

There’s no data for top-down performance, they only asked liaisons to rate the compliance on 
the scale from 0 = 1, they said 0,34 


OUTCOMES 


The two primary outcomes are: 

1. Relative state legitimacy 

2. Relative state governance 
Authors also check the residents perception of absolute levels of state and combo governance 
and legitimacy. 
Both measures come from a 2019 survey. Where experimental sample and representative 
sample are different. The city only surveyed 21 residents on 7-10 randomly selected blocks per 
barrio. Non of these blocks are located in the experimental area. For this area the authors 
interviewed 3-5 residents of 9 blocks in each sector. 


Table 1: State and combo governance and legitimacy, barrio survey averages, 2019 


Frequency/Rate (0-1 Scale) Relative State - Combo 


City-wide Experimental 


State Combo 
survey control group 
Estimate SD Estimate SD 
(1) (2) (3) (4) (5) (6) 
Governance Index 0.41 0.26 0.34 0.29 0.07 0.07 
How often they intervene when: 
HH: Someone is making noise 0.43 0.38 0.19 0.30 0.23 0.26 
HH: Home improvements affect neighbors 0.41 0.38 0.25 0.34 0.16 0.14 
HH: There is domestic violence 0.51 0.37 0.35 0.37 0.15 0.15 
HH: Two drunks fight on the street 0.54 0.36 0.40 0.37 0.13 0.13 
Biz: Someone disturbs a business 0.50 0.38 0.36 0.38 0.12 0.16 
Biz: You have to react to a robbery 0.52 0.37 0.40 0.39 0.11 0.12 
Biz: It is necessary to prevent a theft 0.45 0.37 0.38 0.39 0.07 0.08 
Biz: Businesses in this sector are robbed 0.42 0.39 0.35 0.38 0.05 0.07 
HH: People smoking marijuana near children 0.29 0.36 0.25 0.36 0.04 0.03 
HH: A car or motorbike is stolen 0.46 0.37 0.43 0.38 0.04 -0.01 
HH: Someone is threatening someone else 0.42 0.36 0.41 0.37 0.01 -0.01 
HH: You have to react to a robbery 0.46 0.36 0.45 0.38 0.01 -0.02 
HH: Someone is mugged on the street 0.39 0.36 0.41 0.38 -0.01 -0.05 
HH: It is necessary to prevent a theft 0.40 0.36 0.42 0.38 -0.03 -0.04 
HH: Kids fight on the street 0.29 0.35 0.32 0.37 -0.04 -0.03 
Biz: Someone does not want to pay a debt 0.17 0.31 0.23 0.35 -0.06 -0.05 
HH: Someone refuses to pay a big debt 0.22 0.31 0.39 0.38 -0.16 -0.20 
Legitimacy Index 0.58 0.21 0.43 0.28 0.13 0.13 
When solving problems in the neighborhood: 
How much do you trust the... 0.57 0.30 0.36 0.36 0.19 0.20 
How fair is the... 0.55 0.27 0.41 0.35 0.11 0.12 
How do you rate the... 0.60 0.22 0.51 0.28 0.09 0.09 
How would your neighbors rate the ... 0.59 0.23 0.50 0.29 0.09 0.08 
How much do your neighbors trust the... 0.57 0.28 0.47 0.36 0.09 0.06 


Notes: The governance and legitimacy indexes are averages of the component questions listed in this table. Columns 1-5 
present averages from the city-wide survey, representative of Medellin ’s 224 low- and middle-income barrios, with 20-25 
respondents per barrio. Column 6 reports averages for the experimental sample of 80 sectors, with roughly 30 respondents 
per sector. The Relative State measures in Columns 5 and 6 are the differences between columns 1 and 3. All governance 
scales correspond to: 0 = Never, 0.33 = Occasionally, 0.66 = Frequently, 1 = Always. All legitimacy scales correspond 
to: 0 = Nothing, 0.33 = A little, 0.66 = Somewhat, 1 = Very. Both households (HH) and businesses (Biz) were surveyed 
on governance levels, but only households were surveyed on legitimacy (hence there are fewer observations). 


BASELINE DATA 

Authors surveyed three official per sector for relative governance service provided by the 
combo and the state, relative street presence of the combo and the state, their perceptions of 
local security and drug use. 


Experimental procedure. 

Group 80 sectors into 40 matched pairs using five baseline measures. Relative state-combo 
governance, relative state-combo street presence, insecurity perceptions, administrative crime 
reports and distance to public services and infrastructure. Then randomized which part of the 
match is gonna receive the treatment. Balance in horizontal axis. 


SPILLOVERS 


They used the “representative city-wide” survey test for spillover effects into non-treated areas, 


by comparing blocks close to treatment sectors to those close to control sectors. 


ESTIMATION 


They estimate the Intend To Treat with the ecuation: 


Y_isb= outcome from survey respondent i in the sector s and match pair b. 
T= indicator for random assignment to the treatment 
X prespecified vector of controls and fixed effects. 
The standard errors are clustered at the sector level. 
They expect to detect changes in state governance and legitimacy of about 12% with a two tailed test. 


Yisb =art b Í; T OXisb + Eisb 


To point out heterogeneity in the analysis authors estimate sub-groups impact with the 


equatior 


Yis =a+ BT,+6(T, x Lows) + ALow, + OXisb + Eisb 


Low is an indicator for neighborhoods with below-median state governance. Then B estimates 
the program impact on relatively high-state neighborhoods. Sigma estimates the difference 
between high and low neighborhoods. B+Sigma estimates the impact on low-state 


neighborhoods. 


RESULTS. Table 3 reports 
Average Treatment 

Effects on six survey questions 
as wellasa 

family index averaging all six 


Table 3: Did citizens notice increases in state activity? Survey-based measures, average 


treatment effects, and heterogeneity by initial relative state governance 


Het. by baseline rel. gov. 


a ei ; Control Estimate Estimate Estimate Estimate 
: i Dependent variable E (SE) (SE) (SE) (SE) 
There is no notice residents 
notice the change in alcaldía = 2 (3) (4) (5) 
activities Index of first-stage variables (0-1) 0.33 0.002 0.041*** -0.039*** 0.080*** 
Average changeit Gvenll E (0.27) (0.010) (0.013) (0.012) (0.018) 
sabiamos quëesta Attended State events 0.21 -0.007 0.025 -0.042**  0.067** 
. a (0.41) (0.014) (0.019) (0.019) (0.026) 
heterogeneidad podia ir en Knew about State events 0.52 0.020 0.090**  -0.055* 0.145*** 
cualquier direccion, pero (0.50) (0.025) (0.036) (0.032) (0.048) 
nuestra hipotesis era que hay Attended community events 0.10 -0.014 0.005 -0.034** 0.039* 
rendimientos marginales (0.30) (0.011) (0.016) (0.013) (0.021) 
decrecientes para el personal y Knew about community events 0.30 -0.046** 0.004 -0.098*** 0.102*** 
la atención estatales, lo que (0.46) (0.019) (0.020) (0.026) (0.032) 
significa que la intervención Saw mayoral employees 0.61 0.036** 0.068*** 0.001 0.067** 
seria mas notoria y efectiva en (0.49) (0.016) (0.024) (0.020) (0.030) 
los vecindarios menos Interacted with mayoral employees 0.24 0.022 0.052* -0.009 0.061* 
(0.43) (0.015) (0.027) (0.015) (0.032) 


atendidos. 


Notes: This table reports answers to six Yes/No questions in the survey regarding whether residents 


Each row is a different de- 
pendent variable. Column 1 reports control sector means. Column 2 intent-to-treat (ITT) estimates 


of program impacts using Equation 1. Columns (3) to (5) report treatment heterogeneity using 
Equation 1—treatment effects in sectors above and below the median level of baseline relative state 
governance, and the difference between the two groups. The unit of observation is the individual 
survey respondent, and we cluster standard errors at the sector level (the unit of randomization). 


In the neighborhoods where the central state had the least relative presence, there are 
indications that the city’s central task force and other senior actors had trouble delivering on 
the promises. Top-down compliance appears to be lowest in the sectors with low initial state 
presence. 


WTF with figure 5 i didnt get any of that 


Why do we observe adverse effects in poorly governed neighbourhoods? It is less clear why 
residents in relatively poorly governed sectors should report knowing about and attending 
fewer events compared to control sectors. 

We see no evidence the intervention improved state performance overall, consistent with our 
first-stage results. 


Table 4: Program impacts on governance and legitimacy: Average treatment effects and 
heterogeneity by baseline governance quality 


Het. by baseline rel. gov. 
Above Below 


ATE median median Be 
Control Estimate Estimate Estimate Estimate 
Dependent variable Gb (SE) (SE) (SE) (SE) 


a o @) @ © 


Relative state governance index 0.07 -0.024* -0.016 -0.033* 0.017 
(0.31) (0.014) (0.020) (0.018) (0.026) 


State governance index 0.41 -0.013 -0.007 -0.019% 0.011 
(0.26) (0.009) (0.012) (0.011) (0.016) 
Combo governance index 0.35 0.009 0.007 0.012 -0.004 


(0.28) (0.012) (0.018) (0.016) (0.023) 


Relative state legitimacy index 0.13 0.017 0.053** -0.021 0.074** 
(0.32) (0.018) (0.023) (0.029) (0.037) 


State legitimacy index 0.57 0.010 0.029*** -0.010 0.039*** 
(0.21) (0.007) (0.010) (0.010) (0.014) 
Combo legitimacy index 0.44 -0.006 -0.022 0.011 -0.033 


(0.28) (0.014) (0.017) (0.023) (0.029) 


Notes: The table reports intent-to-treat (ITT) estimates of program impacts and treatment 

heterogeneity using Equations 1 and 1. Each row is a different dependent variable. For the 
ITT estimates (Column 1) we regress each dependent variable on an indicator for treatment 
and our prespecified control vector: 5 baseline variables and sector-pair fixed effects. The 
unit of observation is the individual survey respondent, and we cluster standard errors at 
the sector level (the unit of randomization). Columns (2) to (4) report treatment effects 
in sectors above and below the median level of baseline relative state governance, and 
the difference between the two groups. Both households and businesses were surveyed on 
governance levels (N=2,379), but only households were surveyed on legitimacy and hence 
there are fewer observations (N=1,910). 


IMPACTS ON CALLS AND CALLS TO THE POLICE 


There’s no overall effect but using initially well governed sectors the intervention appears to 
have reduces property crimes, fights and associated emergency calls to the police. 


Table 5: Program impacts on crime index components: Average treatment effects and 
heterogeneity by baseline governance quality 


Het. by baseline rel. gov. 


ATE Above Below Diff. 


median median 


Control 
Dependent variable Mean 
(SD) 


(1) (2) (3) (4) (5) 
Sentence-weighted crime index 0.35 -0.031 -0.096* 0.052 0.147" 


(0.26) (0.039) (0.053) (0.052) (0.074) 


Estimate Estimate Estimate Estimate 


(SE) (SE) (SE) (SE) 


Homicides 0.04 0.026* 0.026 0.029 -0.003 
(0.05) (0.014) (0.020) (0.020) (0.028) 
Vechicle thefts 0.33 -0.007 -0.074 0.080 -0.154 
(0.31) (0.051) (0.071) (0.071) (0.100) 
Thefts and robbery 1.44 -0.298 -0.645** 0.140 -0.786* 
(1.48) (0.229) (0.313) (0.313) (0.440) 
Assaults 0.64 -0.061 -0.132 0.015 -0.147 


(0.39) (0.062) (0.088) (0.088) (0.124) 


Table 5 and 6 show all crimes and 
calls within a sector radius. 

The table reports and index of all 
crimes reported, with crimes 
weighted by their severity (proxied 
by sentence length guidelines for 
each crime). 

Crime report is only completed 
when denuncian. 

The divergence between above and 
below median sector is even 
greater. A 0.147 decline. 

The intervention in educated 
communities could increase crime 
reporting in treated sectors leading 
to understate treatment eddects. 
Sesgo hacia arriba. 


Table 6: Impacts of treatment on resident calls to police 


Het. by baseline rel. gov. 


"r ATE Above median Below median Difference 
Initially well governed 
sectors municipality staff is Dependent vanable ae Estimate Estimate Estimate Estimate 
either dealing with everyday (SD) (SE) (SE) (SE) (SE) 
street disorder without the (1) (2) (3) (4) (5) 
police or succesfully : Resident calls to police 135.76 -25.026 55 .260** 8.474 -63.733** - 
prevented forms of disorder. (102.30) (16.136) (22.392) (22.357) (31.507) 
There is no change in calls to Physical altercations 93.34 -15.179  -32.502** 2.623 -35.125* 
the police overall, but in (58.36) (10.086) (14.179) (14.158) (19.952) 
above median treated Narcotics related incidents 30.97 -9.105 -21.228 5.328 -26.556 
sectors calls fall by 55 (60.11) (9.474) (13.295) (13.274) (18.707) 
relatice to a control mean of Armed incidents 11.45 -0.742 -1.529 0.524 -2.053 
136 (7.97) (1.548) (2.183) (2.180) (3.072) 
Knife related incidents 9.25 -0.942 -2.108 0.437 -2.545 
(6.95) (1.240) (1.760) (1.757) (2.476) 
Firearm related incidents 2.20 0.200 0.579 0.086 0.492 
(2.44) (0.643) (0.898) (0.897) (1.264) 


Notes: This table reports the total number of resident calls to the police emergency line over 20 
months, including all calls made within each sector plus a 125 meter buffer zone around the sector. 
Calls are only geolocated within the city if the police actually respond to the call, meaning we 
cannot track impacts on unmet calls. But administrative records suggest that more than 97% of 


calls receive a response, and so are unlikely to affect out results. Average treatment effects and 
treatment heterogeneity are calculated using the same approach as in Table 4. 


Measurement error correlated with the treatment. 

Answers are self-reported data, so super biased answering. They don’t think presence of 
combos disported responses. 

For the results to be spurious the answers need a very specific pattern of misreporting. 

To attack biased about security fee payment they asked some respondents directly whether 
they paid (Direct Response) and others participated in the (Randomized-response)where they 
privately flipped a coin and responded to the question honestly or not depending on the flip. 
This method has detected under-reporting of sensitive behaviours. 

Since they are not differences in payment reported then there is no misreport 


Conclusions 

It is striking that we see no evidence of a positive impact on average. At the very least, these 
results suggest civilian alternatives to policing are difficult and complex. Interviews and our 
prespecified heterogeneity analysis suggest that the return to public investment was high in 
some neighborhoods, and negative in others. 

One implication could be that there may be increasing returns to state governance, at least at 
low initial levels of state governance. The returns to investments in state capacity when state 
capacity is low could be small or even negative. 


